69 research outputs found
A Scaling Law to Predict the Finite-Length Performance of Spatially-Coupled LDPC Codes
Spatially-coupled LDPC codes are known to have excellent asymptotic
properties. Much less is known regarding their finite-length performance. We
propose a scaling law to predict the error probability of finite-length
spatially-coupled ensembles when transmission takes place over the binary
erasure channel. We discuss how the parameters of the scaling law are connected
to fundamental quantities appearing in the asymptotic analysis of these
ensembles and we verify that the predictions of the scaling law fit well to the
data derived from simulations over a wide range of parameters. The ultimate
goal of this line of research is to develop analytic tools for the design of
spatially-coupled LDPC codes under practical constraints
From Polar to Reed-Muller Codes: a Technique to Improve the Finite-Length Performance
We explore the relationship between polar and RM codes and we describe a
coding scheme which improves upon the performance of the standard polar code at
practical block lengths. Our starting point is the experimental observation
that RM codes have a smaller error probability than polar codes under MAP
decoding. This motivates us to introduce a family of codes that "interpolates"
between RM and polar codes, call this family , where is
the original polar code, and is an RM code.
Based on numerical observations, we remark that the error probability under MAP
decoding is an increasing function of . MAP decoding has in general
exponential complexity, but empirically the performance of polar codes at
finite block lengths is boosted by moving along the family even under low-complexity decoding schemes such as, for instance,
belief propagation or successive cancellation list decoder. We demonstrate the
performance gain via numerical simulations for transmission over the erasure
channel as well as the Gaussian channel.Comment: 8 pages, 7 figures, in IEEE Transactions on Communications, 2014 and
in ISIT'1
How to Achieve the Capacity of Asymmetric Channels
We survey coding techniques that enable reliable transmission at rates that
approach the capacity of an arbitrary discrete memoryless channel. In
particular, we take the point of view of modern coding theory and discuss how
recent advances in coding for symmetric channels help provide more efficient
solutions for the asymmetric case. We consider, in more detail, three basic
coding paradigms.
The first one is Gallager's scheme that consists of concatenating a linear
code with a non-linear mapping so that the input distribution can be
appropriately shaped. We explicitly show that both polar codes and spatially
coupled codes can be employed in this scenario. Furthermore, we derive a
scaling law between the gap to capacity, the cardinality of the input and
output alphabets, and the required size of the mapper.
The second one is an integrated scheme in which the code is used both for
source coding, in order to create codewords distributed according to the
capacity-achieving input distribution, and for channel coding, in order to
provide error protection. Such a technique has been recently introduced by
Honda and Yamamoto in the context of polar codes, and we show how to apply it
also to the design of sparse graph codes.
The third paradigm is based on an idea of B\"ocherer and Mathar, and
separates the two tasks of source coding and channel coding by a chaining
construction that binds together several codewords. We present conditions for
the source code and the channel code, and we describe how to combine any source
code with any channel code that fulfill those conditions, in order to provide
capacity-achieving schemes for asymmetric channels. In particular, we show that
polar codes, spatially coupled codes, and homophonic codes are suitable as
basic building blocks of the proposed coding strategy.Comment: 32 pages, 4 figures, presented in part at Allerton'14 and published
in IEEE Trans. Inform. Theor
Construction of Polar Codes with Sublinear Complexity
Consider the problem of constructing a polar code of block length for the
transmission over a given channel . Typically this requires to compute the
reliability of all the synthetic channels and then to include those that
are sufficiently reliable. However, we know from [1], [2] that there is a
partial order among the synthetic channels. Hence, it is natural to ask whether
we can exploit it to reduce the computational burden of the construction
problem.
We show that, if we take advantage of the partial order [1], [2], we can
construct a polar code by computing the reliability of roughly a fraction
of the synthetic channels. In particular, we prove that
is a lower bound on the number of synthetic channels to be
considered and such a bound is tight up to a multiplicative factor . This set of roughly synthetic channels is universal, in
the sense that it allows one to construct polar codes for any , and it can
be identified by solving a maximum matching problem on a bipartite graph.
Our proof technique consists of reducing the construction problem to the
problem of computing the maximum cardinality of an antichain for a suitable
partially ordered set. As such, this method is general and it can be used to
further improve the complexity of the construction problem in case a new
partial order on the synthetic channels of polar codes is discovered.Comment: 9 pages, 3 figures, presented at ISIT'17 and submitted to IEEE Trans.
Inform. Theor
- …